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Abstract 


The  generalized  lattice  point  problem,  posed  by  Charnes  and 
studied  by  M.  J.  L.  Kirby,  H.  Love  and  others,  is  a  linear  program  whose 
solutions  are  constrained  to  be  extreme  points  of  a  specified  polytope.  We 
show  how  to  exploit  this  and  more  general  problems  by  convexity  (or  inter¬ 
section)  cut  strategies  without  resorting  to  standard  problem  augmenting 
techniques  such  as  introducing  0-1  variables.  In  addition,  we  show  how  to 
circumvent  "degeneracy"  difficulties  inherent  in  this  problem  without  rely¬ 
ing  on  perturbation  (which  provides  us*  lessly  shallow  cuts)  by  identifying 
nondegenerate  subregions  relative  to  which  cuts  may  be  effectively  defined. 
Finally,  we  give  results  that  make  it  possible  to  obtain  strengthened  cuts 
for  problems  with  special  structures. 


1.  Introduction 


The  generalized  lattice  point  (GL.P)  problem  (first  posed  by  A.  Charnes 
[6])*  subsumes  a  wide  variety  of  combinatorial  programming  problems,  in¬ 
cluding  the  mixed  0-1  problem  of  integer  linear  programming. 

The  GLP  problem,  while  remarkably  easy  to  state,  is  not  amenable 
to  solution  by  standard  optimization  methods  because  of  its  generality  and 
the  non-convexity  of  its  feasible  region.  For  instance,  solution  approaches 

based  on  certain  "purification"  and  "decomposition"  principles  have  been 
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studied  by  several  researchers,  but  may  fail  because  it  is  not  possible  to 
generate  the  appropriate  tableau  information  or  because  insufficient  criteria 
are  manufactured  to  distinguish  local  from  global  optima. 

The  solution  method  presented  in  this  paper  for  the  GLP  problem  is 
based  on  the  "convexity  cut"  ideas  developed  by  Young  [16]  and  Balas  [1]  (in 
the  context  of  mixed  integer  programming)  and  by  Tui  [15]  (in  the  context  of 
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concave  programming),  utilizing  the  extended  conceptual  framework  due  to 
Glover  [8], 

The  key  obstacle  to  applying  convexity  cuts  to  the  GLP  problem  is 
the  occurance  of  certain  "degeneracy"  difficulties  which  are  not  present  in 
the  integer  programming  applications  and  which  are  not  resolvable  by  per¬ 
turbation.  In  fact,  we  show  that  perturbation  is  useless  in  the  creation  of 
convexity  cuts,  which  demonstrates  that  reliance  on  perturbation  t<  overcome 
degeneracy  in  the  use  of  these  cuts,  as  proposed  in  the  concave  programming 
context,  is  unfortunately  unworkable. 
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The  work  of  this  paper  enlarges  the  applicability  of  convexity  cuts 
in  two  ways.  First,  we  show  how  to  resolve  the  fundamental  degeneracy 
difficulties  associated  with  the  GLP  problem  without  relying  on  perturba¬ 
tion.  Second,  we  give  results  for  strengthening  these  cuts  for  GLP  problems 
with  special  structures. 

2.  Problem  Statement 

We  define  the  GLP  problem  to  be  that  of  finding  a  vector  x  e  Rn  to 
Minimize  cx 
Subject  to:  Ax  *  b 
x  *  0 

and  x  lies  on  an  n  -  q  dimensional  face  of  the 
polytope  Q  !  [x:  DxSd}, 

where  n^q^O  and  all  matrices  and  vectors  are,  of  course,  assumed  to  be 
dimensioned  conformably.  By  the  statement  that  x  lies  on  an  n  -  q  dimen¬ 
sional  face  of  Q  we  mean  we  mean  x  e  Q  and  D*x  -  d-  =  0  for  at  least  q 
linearly  independent  rows  D*  of  D  (where  q  *  rank  (D)). 

For  simplicity  in  the  following  we  shall  assume  that  the  inequality 
x  *  0  is  absorbed  into  the  matrix  inequality  Ax  s  b  (except  for  any  com¬ 
ponents  of  this  inequality  that  are  already  contained  in  Dx  *  d)  and  that  none 
of  the  row  inequalities  of  Ax  *  b  duplicate  those  of  Dx  *  d.  (Duplicate 
inequalities  may,  of  course,  be  deleted  from  Ax  *  b  without  altering  the 
problem.  ) 

Introducing  slack  variables  u  =  d  -  Dx  and  v  =  b  -  Ax,  we  define 
the  polytopes 

P  =  {x:  v  a  0} 

Q  =  (x:  u*  0} 
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and  also  define 

Q*  =  t> :  x  lies  on  an  n-q  dimensional  face  of  Q)  . 

The  GLP  problem  may  then  be  written 
Minimize  cx  . 

x  c  pno* 

Corresponding  to  the  GLP  problem,  we  shall  define  a  relaxed  problem  which 
arises  by  replacing  Q *  with  Q  to  yield  the  ordinary  linear  program 


Minimize  cx 
x  e  PDQ 


Clearly,  if  an  optimal  solution  to  the  relaxed  problem  Is  feasible  for 
the  GLP  problem,  then  it  must  be  optimal  for  the  GLP  problem. 

3.  Tableau  ReprggentgUgn  of  the .Gtf.frofrlgm 

We  assume  (without  loss  of  generality)  that  the  problem  con¬ 
straints  and  variables  are  indexed  so  that  the  equations  u  =  d  -  Dx  and 
v  =  b  -  Ax  have  the  form 


Uj  =  dj  -  DjX 


and 


xx  =  0  +  Xj 


xn  =  U  +  xn 

VI  =  bI*  AIX 


where  u  =  (yj),  v=  (^j1)  and  x  =  (£j  ).  Thus,  defining  y  =  $),  the  con¬ 
ditions  0  and  v  *  0  may  alternately  be  written 


a  0 


A 
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These  notatlonal  assumptions  Insure  that  the  linear  programming  "column 
tableau"  representation  for  the  relaxed  problem  has  a  convenient  structure 
that  simplifies  the  identification  of  the  "current  x  vector/'  Specifically, 

i 

the  initial  column  tableau  representation  is  given  by 

maximize  xQ  »  0  +  c(-x) 
subject  to  u  =  d  +  D(-x) 
v  =  b  +  A(-x) 
u*  0,  v»0 

or,  in  more  compressed  form,  by 

Maximize  xq  *  0  +  c(-x) 
subject  to  y  *  Bq+  B(-x) 
y  *  0 

where  BQ  =  (^)  and  B  =  ^).  (Maximizing  xQ  *=  -cx,  of  course,  corresponds 
to  minimizing  cx. )  It  may  be  noted  that  the  "middle  equations"  of  this  tableau 
representation  are  simply  the  identity  equations 

x,  “  ,I=1 . "• 

The  components  of  x  are  the  nonbaslc  variables  for  this  initial  tab¬ 
leau,  and  setting  x  =  0  uniquely  determines  the  linear  programming  extreme 
point  (or  "basic")  solution:  xQ  ■  0,  y  *  BQ.  This  solution  is  defined  to  be 
primal  feasible  if  BQ  *  0,  in  which  case  it  follows  that  x  «  P  ftQ.  The 
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solution  is  defined  to  be  dual  feasible  if  c  i  0,  By  standard  linear  pro¬ 
gramming  theory,  a  basic  solution  that  is  both  primal  and  dual  feasible  is 
optimal  for  the  relaxed  problem. 

We  write  the  more  general  current  tableau  representation  of  the 
problem  in  the  analogous  form 

Maximize  x  =  crt  +  c(-t) 
o  o 

subject  to  y  =  B0+  B(-t) 

y  ::  o 

where  the  y  vector  is  the  same  as  before,  but  where  t  denotes  any  set  of 
"current  nonbasic  variables"  (hence  its  components  constitute  a  subset  of 
the  components  of  y).  The  scalar  c  ,  the  vectors  c  and  BQ,  and  the  matrix 
B  will  depend  upon  the  composition  of  t.  This  composition  may  be  identified 
by  n  of  the  equations  of  y  -  BQ  -  Bt,  which  have  the  form 

yi  "  -'-V 

where  of  course  j  depends  on  i.  These  again  are  identity  equations,  corres- 
ponding  to  the  previously  indicated  identity  equations  of  the  initial  tableau/* 

Example  of  the  GLP  Problem  in  Tableau  Form 

To  illustrate  the  foregoing  tableau  representation  of  the  GLP  problem 
consider  the  problem 

Minimize  -3x^  +  4x2  ”  ®x3 

2x j  -  |  x £  +  2xg  £  7 

xl»  x2'  x3  *  0 


subject  to 
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where  x  is  required  to  lie  on  a  one  dimensional  face  of  the  polytope  defined 
by 

Xj  +  x2  +  x3  s;  4 
*X1  "  x2  '  x3  S  '3 

Xj  *  0  . 

Then  (eliminating  xi  *  0  since  it  is  accommodated  in  Q  to  follow), 

P  =  [x:  2xl  -  x2  +  2x3  s7,  x2  >  0,  x3  i  0} 

Q  =  [x:  xx  +  x2  +  x3  i  4,  -xj  -  x2  -X3  *  -3,  X!  *  0] 
and  the  tableau  representation  is: 

Maximize  xQ  =  0  -  3(-x^)  +  4(-x2)  -  6(-x3) 
subject  to 

yt  =  4  +  l(-Xj)  +  l(-x2)  +  l(-x3) 
y2  -  -3  -  l(-Xj)  -  l(-x2)  -  l(-x3) 
y3  =  0  -H-Xj) 
y4  =  0  -  i(-x2) 

y5  =  0  “  1^x3) 

yg  =  7  +  2(-xp  -  l(-x2)  +  2(-x3) 
y  i  0 

where  yj  =  Uj,  y2  =  U2 '  y3  =  u3  =  xp  y4  =  V1  =  x2'  ys  =  v2  *  x3'  y6  “  v3‘ 
In  the  detached  coefficient  form 


y 


co 

c 

Bo 

B 

To  illustrate  how  to  identify  the  optimality  criteria  for  the  GLP 


problem  in  terms  of  the  tableau  format,  we  first  pivot  on  the  coefficient  2 


indicated  by  the  asterisk  in  the  preceding  tableau  to  obtain 


u. 


A1 

x2 


“X1 

"x2 

-v3 

21 

3 

1 

3 

1/2 

0 

3/2 

-1/2 

1/2 

0 

-3/2 

1/2 

0 

-1 

0 

0 

0 

0 

-1 

0 

7/2 

1 

-1/2 

1/2 

0 


0 


0 


-1 
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This  tableau  gives  an  optimal  linear  programming  solution  to  the  relaxed 
problem,  since  it  is  both  primal  and  dual  feasible  (BQaO  and  caO,  respectively). 

To  determine  whether  this  solution  to  the  relaxed  problem  also  solves 
the  GLP  problem  we  must  translate  the  feasibility  requirement  of  the  GLP 
problem  into  an  equivalent  requirement  applicable  to  the  linear  programming 
tableau.  The  statement  that  a  vector  x  =  x'  lies  on  an  n  -  q  dimensional 
face  of  Q  (i.e.  ,  x'  c  Q*)  may  be  expressed  in  the  terminology  of  the  column 
tableau  for  which  (i)  the  basic  solution  (y  =  BQ)  yields  x  B  x\  and  (ii )  at  least 
q  of  the  current  non-basic  variables  (components  of  t)  are  also  components  of 
u. 

In  the  foregoing  example  n  -  q  *  1  and  so  q  s  2.  However,  only  1  of  the 
components  of  u  (i.  e.  ,  xj)  is  among  the  current  nonbasic  variables  in  the  final 
tableau.  Moreover,  there  is  no  other  tableau  yielding  the  same  solution  in 
which  2  components  of  u  are  nonbasic,  due  to  the  absence  of  primal  degeneracy. 
(We  show  how  to  take  care  of  degeneracy  in  later  sections.  )  The  existence  of 
such  a  tableau  is  both  necessary  and  sufficient  for  the  current  basic  solution  to 
lie  on  a  one -dimensional  face  of  Q,  and  hence  for  the  solution  to  satisfy  the 
desired  optimality  criteria.  Thus,  the  basic  solution  of  the  current  tableau  does 
not  solve  the  GLP  problem. 

The  main  results  of  this  paper  provide  a  method  for  "cutting  away1' 
such  a  basic  solution  to  the  relaxed  problem  when  it  is  thus  determined  to  be 
infeasible  for  the  GLP  problem.  The  background  for  these  results  is  given  in 


the  next  section. 
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4.  Convexity  Cuts  Preliminaries 

The  convexity  cuts,  In  general,  may  be  applied  to  a  problem  In  which 
It  Is  desired  to  find  a  vector  y  contained  in  the  Intersection  of  the  cone 

C  -  {y:  y  ■  B0  -  Bt,  ti  0} 

and  some  arbitrary  set  S.  The  basic  characterization  of  the  convexity  cuts  Is 
as  follows: 

g 

Convexity  Cut  Lemma  (f81)  Assume  there  is  a  convex  set  R  whose  Interior 
contains  the  vertex  B0  of  C,  but  does  not  contain  any  points  of  S.  Then, 
given  numbers  t*  >  0  such  that 

Bq  -  Bjt*  c  R  for  all  )  ■  1, . . .  ,n 

the  cut 

5  (tj>  t,  »  i  (i) 

Is  satisfied  by  all  y  ■  BQ  -  Bt  such  that  y  c  C  fl  S. 

One  way  to  visualize  the  assertion  of  the  lemma  Is  to  think  of  extend¬ 
ing  the  j1*1  edge  (half  line),  y  *  B0  -  BjtJ#  t^  st  0,  of  the  cone  C  a  "distance" 
t *  >  0  such  that  the  endpoint  of  the  extended  edge  remains  in  the  convex  set 
R.  If  this  Is  done  for  each  edge,  and  a  hyperplane  is  passed  through  the  end¬ 
points  of  these  edges  (disregarding  Bq)  ,  then  the  convexity  cut  lemma  says 
that  all  points  y  of  C  fl  S  must  lie  in  the  associated  half  space  that  does  not 
contain  BQ.  Whenever  B  has  rank  n,  as  it  does  for  the  linear  programming 
tableau,  the  solution  y  =  B0  is  uniquely  determined  for  t  =  0, 
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and  cannot  be  obtained  for  any  y  e  C  satisfying  (1),  which  implies  t  *  0  and 
t  0. 

The  basic  solution  strategy  implied  by  the  convexity  cut  lemma  is  to 
obtain  a  "cone  representation"  of  the  feasible  region,  such  as  that  automa¬ 
tically  given  by  the  linear  programming  tableau,  and  to  determine  a  convex 
set  R  and  numbers  t*  >  0  as  indicated  in  the  lemma.  The  problem  constiaints 
are  then  augmented  by  requiring  (1)  to  hold,  i.e. ,  by  adjoining  the  cut  (1)  to 
the  linear  programming  tableau  and  pivoting  to  a  new  basic  solution  (thus 
obtaining  a  new  cone  representation) .  The  process  repeats  until  BQ  e  S, 
whereupon  y  *  B0  satisfies  y  e  C  0  S. 

Convexity  Cut  Strategy  Exemplified  for  the  GLP  Problem 
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An  appropriate  convexity  cut  for  this  problem  has  been  adjoined  as  a  new 
constraint  row  which  appears  at  the  bottom  of  the  tableau.  The  cut  is  derived 
(using  procedures  to  be  specified  later)  from  the  values  t  j  =  ®.  t  ^  =  1  / 3,  and 
t  j  =  1  (where  tj  =  Xj,  t2  =  X2>  tj  =  v^).  We  have  denoted  the  slack  variable 
that  transforms  the  convexity  cut  inequality  into  an  equality  by  v4,  thereby 
indicating  that  the  cut  is  being  used  to  augment  the  set  of  constraints  defining 
the  polytope  P. 

Applying  the  dual  simplex  method  to  this  tableau  yields  the  pivot  element 
indicated  by  the  asterisk,  and  thus  gives  rise  to  the  new  tableau 


“X1  ~v4  “v3 


At  this  point  the  updated  cut  row  (i.  e. ,  the  v4  row)  can  optionally  be  dropped. 
The  current  tableau  is  primal  and  dual  feasible  and  hence  is  once  again  "locally 
optimal".  Using  the  ideas  presented  in  Section  3,  we  investigate  whether  the 
current  basic  solution  solves  the  GLP  problem.  Only  one  of  the  "u  variables" 

xj),  which  is  one  less  than 


is  nonbasic  (i.  e. , 
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the  number  required.  However,  the  current  tableau  la  degenerate  In  Q  (l.e. , 
In  the  u  variables)  since  the  basic  variable  Uj  receives  a  value  of  0.  More¬ 
over,  both  v4  and  v-j  have  nonzero  coefficients  in  the  Uj  row,  and  hence  ii 
is  possible  to  pivot  on  either  of  these  coefficients  to  obtain  a  new  tableau 
in  which  both  Uj  and  Xj  are  nonbasic,  leaving  the  solution  y  ■  B0  unchanged. 
Thus  the  current  tableau  in  fact  provides  an  optimal  solution  to  the  example 
GLP  problem. 

We  now  develop  the  fundamental  notions  and  procedure  for  implement¬ 
ing  the  convexity  cuts  and  for  accommodating  the  considerations  illustrated  in 
this  example. 

5 .  Determining  a  Convexity  Cut  for  the  GLP  Problem 

Corresponding  to  the  sets  P,  Q,  and  Q*,  we  introduce  counterpart 
sets  P,  0,  and  Q* ,  defined  by: 

P  *  {y:  x  c  P} 

Q  =  {y:  x  e  Q} 

6*=  £ y:  x  c  0*) 


We  note  that  P  and  Q  are  also  given  by  P  *  {y:  v  *  0}  and 
q  =  (y;  u  2  0)  (where  y  =  (Jl  Thus,  for  example,  y  c  P  D  Q  may  equivalently 


n 


be  expressed  as  y  iO, 

Our  first  goal  is  to  specify  the  set  S  of  the  convexity  cut  lemma  in  a 
form  relevant  to  the  GLP  problem.  This  may  be  done  rather  easily,  since 
it  is  sufficient  to  define  S  so  that  the  statement  y  €  C  fi  S  is  equivalent  to 
the  statement  x  €  P  0  Q*.  Thus,  we  let  S  =  (y:  y  i  0  and  y  €  Q*},  which 
implies  S  =  C  fi  S,  since  y  =  B0  -  Bt.  (noting  that  yi  0  implies  t  *0  in  the 
linear  programming  tableau). 

Our  second  goal  is  to  specify  the  convex  set  R  relative  to  which  the  con¬ 
vexity  cut  is  determined.  It  is  instructive  in  pursuing  this  goal  to  identify  the 
"natural"  alternative  for  the  set  R.  By  the  convexity  cut  lemma,  the  interior 
of  R  must  contain  BQ  but  no  points  of  S.  Thus,  a  plausible  first  candidate 
for  R  is  Q.  This  set  is  clearly  convex  and,  moreover,  every  y  that  satis¬ 
fies  y  e  Q*  (and  hence  y  cS)  lies  on  the  "boundary"  of  Q  ,  but  not  in  its  interior. 
However,  there  is  no  assurance  that  Q  will  contain  BQ  in  its  interior.  In  fact, 
this  will  almost  never  occur,  for  y  =  BQ  can  be  in  the  interior  of  Q  (  =  {y:  u  *  0}) 
only  if  u  >  0.  This  latter  implies  not  only  the  absence  of  "degeneracy  in  Q" 

(as  discussed  in  the  preceding  section),  but  also  that  all  of  the  components  of 
u  are  basic.  This  condition  can  never  be  satisfied  in  tableaus  that  are  feasible 
(or  even  "partially  feasible")  for  the  GLP  problem,  since  one  condition  of 
feasibility  is  that  u.  =  0  for  at  least  q  of  the  components  of  u. 
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The  set  P  be  quickly  dismissed  as  a  viable  alternative  for  R, 

since,  although  ,  it  may  quite  possibly  contain  points  of  S  in  its  interior. 

The  set  P  0  Q  overcomes  this  latter  limitation,  but  also  fails,  since  Bq  is 
always  on  its  boundary  (and  in  any  case  this  choice  would  not  be  as  good  as 
Q,  if  Q  were  acceptable,  since  PHQCQ). 

A  more  plausible  approach  is  that  of  "perturbing"  Bq  (when  necessary) 
from  the  boundary  to  the  interior  of  Q,  whereupon  Q  becomes  an  acceptable 
choice  for  R.  However,  such  perturbation,  which  very  satisfactorily  combats 
degeneracy  in  ordinary  linear  programming,  is  totally  useless  in  the 
convexity  cut  context.  To  see  this,  note  that  perturbation  gives  rise 
to  one  of  the  following  two  possibilities.  First,  there  may  be  an  edge  from 
the  perturbed  BQ  that  stays  inside  R  for  no  more  than  an  "e  distance.  "  Con¬ 
sequently,  the  value  of  t*  for  this  edge  is  minutely  small,  and  the  convexity 
cut  eliminates  a  correspondingly  small  "e  neighborhood"  of  B0.  Disregarding 
the  numerical  difficulties  of  dealing  with  an  enormously  large  cut  coefficient 
1/t*  (which  might  be  accommodated, for  example,  by  using  a  non-Archimedean 
ordering) ,  the  new  B0  obtained  after  re-optimizing  with  the  dual  simplex 
method  must  be  essentially  the  same  as  the  perturbed  BQ,  and  the  cut  method 
gets  nowhere. 

The  second  possible  consequence  of  perturbation  is  the  opposite  one, 
that  an  edge  from  the  perturbed  30  now  stays  for  some  distance  in  the  interior 
of  R  when  it  would  have  continued  along  a  boundary  of  R  in  the  absence  of 
perturbation.  (The  case  in  which  all  edges  lead  from  a  boundary  into  the 
interior  of  R  is  automatically  legitimate  by  footnote  6  and  does  not  require 
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perturbation;  hence  we  exclude  it.  )  But  then  points  of  S  on  the  boundary 
of  R  may  be  by-passed  by  the  cut.  Thus,  once  again,  perturbation  is  of  no 
use . 

Our  fundamental  result,  which  specifies  a  superset  of  Q  that  is 
acceptable  in  the  role  of  R,  and  which  does  not  rely  on  perturbation,  is 
given  to  follow. 

Theorem: 

u  * 

Let  y'  =  (  )  ■  Bq  >  0,  and  define  the  index  set  M  =  {i:  uj  t  0}. 

Then,  if  y'  is  not  feasible  for  the  GLP  problem  (BQ  i  S),  the  set  R  =  {y:  u^O, 
i  ®  M}  satisfies  the  assumptions  of  the  convexity  cut  lemma,  i.e.  ,  R  contains 
Bq  but  no  points  of  S  in  its  interior. 

The  set  R  specified  in  the  foregoing  theorem  is  the  superset  of 
Q  =  (y:uiO)  that  results  by  disregarding  all  of  the  inequalities  Uj  =  dj  -Dlx*0 
defining  Q  except  those  that  are  inactive  (i.e.,  for  which  Dlx<dj)  at  the 
solution  y'  =  Bq.  Thus,  the  theorem  rather  surprisingly  (and  pleasantly) 
states  that  one  can  ignore  degeneracy  (and  indeed  all  active  constraints)  in  Q 
when  determining  R. 

The  key  observation  we  shall  use  to  prove  this  theorem  is  the  following: 

Lemma: 

Let  y*  be  a  feasible  solution  for  the  GLP  problem  (i.e. ,  y*  e  S).  Then 
if  y'  =  Bq  i  0  and  B0  4  S,  there  is  an  index  k  such  that  u^  =  0  and  u'k  i  0. 
Proof: 

We  shall  say  that  a  tableau  verifies  y*  e  S  (or  y'  e  S)  if  y*  (or  y') 
is  obtained  as  the  current  basic  solution  and  at  least  q  of  the  components  of 


u  are  nonbasic  in  this  tableau.  Relative  to  a  given  tableau  that  verifies 

y *  e  S,  define  M  '  =  (i:  Uj  is  nonbasic}.  Then,  for  the  sake  of  contradiction, 

suppose  the  lemma  is  false,  whereupon  u’^  =  0  implies  u'^  =  0  for  all 

8 

i  c  M':'.  By  the  basis  exchange  theorem  there  must  exist  a  sequence  of 
pivots  from  the  current  tableau  (in  which  y'  =  BQ)  to  a  new  tableau  in  which 
u.  is  nonbasic  for  all  i  e  M*.  Moreover,  each  pivot  is  executed  by  selecting 
an  i  s  M*  such  that  Uj  is  basic,  and  then  performing  a  basis  exchange  that 
leaves  u-  nonbasic  (replacing  u^  in  the  basis  by  some  variable  that  is  basic 
in  the  tableau  that  verifies  y*  eS,  but  which  is  nonbasic  in  the  crrrent  tableau 
before  the  pivot).  Each  of  these  successive  pivots  leaves  Bq  unchanged,  and 
hence  the  end  result  is  a  tableau  that  verifies  y'  eS.  But  this  violates  the 
assumption  that  y'  is  not  feasible  for  the  GLP  problem,  thereby  completing 
the  proof. 

It  is  interesting  to  consider  a  "separating  hyperplane"  interpretation 
of  the  lemma  by  visualizing  its  implications  geometrically  in  the  space  of  the 
y  vectors.  In  this  context  the  lemma  can  be  restated  in  the  form:  if  y*  is 
feasible  for  the  GLP  problem  but  y'  is  not  (where  y'  =  BQ  *  0),  then  there  is 
at  least  one  constraint  hyperplane  defining  Q  (i.e. ,  a  hyperplane  of  the  form 
{y:  uk  =  0  for  some  k})  that  passes  through  y*  but  that  does  not  pass 
through  y\  This  interpretation  prompts  the  following  speculation.  The  half 
space  {y:  uk  *  0}  corresponding  to  a  constraint  hyperplane  that  passes 
through  y*  but  not  y'  =  B0  must  contain  B0  but  not  y*  in  its  interior.  Moreover, 
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if  y*  is  optimal  for  the  GLP  problem,  then  all  other  feasible  solutions  can 
be  thrown  away  and  S  redefined  to  consist  of  the  single  point  y*.  It  imme¬ 
diately  follows  that  the  half  space  £y :  u^O)  provides  an  acceptable  R  for 
determining  a  convexity  cut. 

Of  course,  such  a  half  space  would  undoubtedly  be  extremely  diffi¬ 
cult  to  identify.  In  fact,  its  identification  would  render  a  cutting  approach 
superfluous,  since  after  q  steps  of  specifying  an  appropriate  index  k  for 
which  one  could  require  u.  to  be  nonbasic,  the  GLP  problem  would  be  solved. 

K 

Nevertheless,  the  fact  that  these  half  spaces  exist  makes  it  possible  to 
specify  an  R  that  can  be  readily  identified,  as  we  now  demonstrate  in  the 
following  proof. 

Proof  of  the  theorem: 

First,  it  is  immediate  that  R  as  specified  in  the  theorem  contains 
Bq  in  its  interior.  Thus,  we  must  show  that  this  interior  contains  none  of 
the  points  of  S.  Let  M'  =  {k:  u'k  t  0  and  u*  =  0  for  some  y*  eS),  and 
let  R*  be  the  intersection  of  the  half  spaces  {y:  u^  iO],  k  e  M'.  By  the 
lemma,  every  y*  e  S  must  lie  on  a  hyperplane  {y:  u^  =  0)  for  some  k  e  M'. 
Thus  y*  e  S  implies  y*  cannot  be  contained  in  the  interior  of  R*.  But 
M'  C  M,  and  hence  the  set  R  of  the  theorem  (which  is  the  intersection  of 


the  half  spaces  {y:  u^  ^  0],  k  eM)  must  be  contained  in  R*.  This  completes 
the  proof.  + 
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6 .  Implementation  of  the  Convexity  Cuts  for  the  GLP  Problem 

Having  specified  an  appropriate  R  ,  two  tasks  remain  in  order  to 
implement  the  convexity  cuts.  The  tasks  are: 

1)  To  provide  explicit  criteria  for  determining  when  Bq  e  S . 

2)  To  specify  the  calculation  of  the  numbers  t*. 

We  consider  these  tasks  in  sequence. 

Determining  whether  Bn^  S 

The  first  task,  applied  to  a  primal  feasible  tableau,  involves  deter¬ 
mining  whether  there  exists  a  series  of  degenerate  pivots  that  will  yield  at 
least  q  components  of  u  nonbaslc  (if  this  is  not  already  the  case).  Some¬ 
times  simple  inspection  of  the  tableau  will  provide  the  answer,  and  some¬ 
times  it  may  actually  be  necessary  to  carry  out  several  degenerate  pivots. 

The  key  is  this:  as  long  as  there  is  a  degenerate  basic  u^  whose  tableau  row 
contains  a  nonzero  coefficient  in  the  column  of  a  nonbasic  vJ#  then  a  pivot 
may  be  made  on  this  nonzero  coefficient  yielding  a  new  tableau  in  which  one 
more  component  of  u  is  nonbasic  (and  BQ  remains  unchanged) .  If  there  are  no 
such  Uj,  then  the  current  tableau  contains  the  maximum  number  of  nonbasic 
Uj  for  any  tableau  with  the  same  BQ. 

In  particular,  if  the  current  tableau  has  r  of  the  uA  nonbasic,  and  if 
fewer  than  q  -  r  of  the  nonbasic  v^  have  a  nonzero  coefficient  in  at  least  one 
of  the  degenerate  rows,  then  it  is  clear  that  Bq  e  S  (without  having  to 
pivot) .  On  the  other  hand,  if  il  is  known  from  the  structure  of  the  constraint 


Inequality  Dx  *  d  that  all  O-valued  Uj  can  be  made  nonbaslc,  then  checking 
for  B0  c  S  becomes  merely  a  matter  of  counting  (see  Section  7) .  Other  struc¬ 
tures  can,  of  course,  provide  other  shortcuts  for  checking  whether  B0  e  SQ. 
However,  it  seems  intuitively  reasonable  that  the  convexity  cut  will  tend  to 
be  stronger  if  a  tableau  is  used  that  has  a  maximum  number  of  ut  nonbaslc. 
Calculating  t^ 

The  second  task,  calculating  the  t*  values,  corresponds  precisely 
to  the  task  of  determining  the  amount  a  nonbaslc  variable  can  be  increased 
without  violating  primal  feasibility  in  the  application  of  the  primal  simplex 
method.  However,  primal  feasibility  in  the  present  context  is  restricted  to 
the  tableau  rows  corresponding  to  "basic  non-degenerate  u^"  (l.e. ,  1  e  M). 
Thus,  Specifically,  it  follows  that 

t*  -  Min.  [bfcAiP 

1  1  c  M 

bl3  >  0 

where  biQ  is  the  ith  component  of  B0  and  btJ  is  the  ljth  component  of  B. 

(By  convention  t*  -  •  if  *  0  for  all  i  c  M.)  This  value  is,  of  course, 
always  positive  since  bjQ  >0  for  all  1  e  M . 

7.  Special  Structures  and  Strengthened  Cuts 

The  issue  of  special  structures  was  briefly  touched  on  in  the  preceding 


section,  where  we  remarked  that  for  some  structures  the  problem  of  checking 
whether  y  e  0*  reduces  to  checking  the  number  of  0 -valued  u4.  Such  structures 
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are  of  interest  for  more  than  their  ability  to  facilitate  checking  y  cQ*, 
howevc  r,  as  we  now  indicate. 

We  shall  way  that  a  GLP  problem  has  the  counting  property  provided 
that  the  condition  "D*x  =  d,  (hence  Uj  =  0)  for  q  or  more  of  the  rows  D* 
of  D"  implies  that  at  least  q  of  these  rows  D*  are  linear  ly  independent. 

By  definition,  the  counting  property  implies  y  e  Q*  if  and  only  if  y  e  Q 
and  u4  =  0  for  at  least  q  components  of  u.  The  0-1  mixed  integer  pro¬ 
gramming  problem  obviously  has  the  counting  property  since  in  this  case 

Dx  *  d  summarizes  the  constraints  x  *  1  and  -x.  *0,  j  =  1, .  . . ,  q. 

J  J 

Similarly,  it  is  clear  that  any  problem  has  the  counting  property  for  which 
Dx  *  d  summarizes  sets  of  constraint  pairs  H*x  *  h^  and  -H*x  *kj,  where 
all  of  the  H*  are  linearly  independent  and  kj  j  -h^.  Rather  than  attempt  to 
characterize  more  general  structures  that  give  rise  to  the  counting  property, 
however,  we  note  that  these  problems  are  subsumed  in  a  larger  class  of 
"quasi-GLP"  problems  in  which  Q*  is  redefined  to  be  (y:ye  Q  and  Uj  =  0 
for  at  least  q  components  of  u},  ignoring  whether  the  associated  rows  D1 
of  D  are  linearly  independent.  The  fundamental  results  of  Section  5  apply 
as  readily  to  the  quasi-GLP  problem  as  to  the  GLP  problem  itself,  and 
hence  the  previously  indicated  convexity  cuts  can  be  the  same  for  both 
problems.  (The  altered  definition  of  Q*,  of  course,  alters  the  definition  of 
S  correspondingly.  ) 

A  more  important  observation  concerns  the  ability  to  obtain  stronger 
cuts  for  the  GLP  problem.  Suppose  that  the  matrix  D  (upon  re -indexing)  is 
partitioned  into  two  submatrices 
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D  - 

where  the  rank  of  D'  Is  q'  <  q.  Then,  if  x  lies  on  an  n  -  q  dimensional 
face  of  D,  it  must  also  lie  on  an  n  -  p  dimensional  face  of  D",  where 
p  “  q  -  q*.  Thus,  whenever  fewer  than  p  of  the  components  of  u  associated 
with  D"  can  be  made  nonbasic  in  the  current  basic  solution,  then  a  convexity 
cut  can  be  determined  relative  to  D"x  £  d"  Instead  of  Dx  *  d.  This  must 
yield  a  cut  at  least  as  strong  as  the  one  for  Dx  *  d,  since  the  half  spaces 
whose  intersection  determines  R  are  reduced  in  number  whenever  D'x  /  d', 
thereby  enlarging  R. 

The  special  structures  previously  indicated  very  conveniently  submit 
to  such  partitioning,  since  it  suffices  to  let  D'x  *  cT  summarize  any  q  -  1  pairs 
of  the  constraints  H*x  sc  hj,  -Hlx  s  kj;  and,  in  fact,  any  choice  of  these  pairs 
will  yield  a  convexity  cut  (when  y  t  S)  provided  D"x  /  dM.  The  best  choices 
are,  of  course,  those  that  assign  as  many  of  the  unsatisfied  constraints  of 
Dx  s  d  to  D'x  £  d'  as  possible  (provided  at  least  one  is  assigned  to  D”x  s  d"). 
Such  choices  are  trivial  for  the  0-1  mixed  integer  problem  for  then  D"x  *  d" 
can  be  selected  to  be  any  single  pair  of  constraints  x^  £  1  and  -Xj  £  0  such 
that  Xj  i*  0  or  1  in  the  current  basic  solution.  Convexity  cuts  determined  in  this 

fashion  for  the  0-1  problem  correspond  precisely  to  the  mixed  integer  cuts 

g 

proposed  by  Gomory  in  (12). 

By  Introducing  a  number  of  additional  variables  and  constraints ,  a 
variety  of  GLP  problems  (and  all  quasi-GLP  problems)  can  be  given  a  0  -  1 
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mixed  integer  formulation.  Interestingly  enough,  however,  it  can  be  shown 

that  the  mixed  integer  cuts  of  ( 12]  applied  to  such  a  formulation  will  be 
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generally  weaker  than  the  convexity  cuts  indicated  here.  A  similar  state¬ 
ment  applies  to  certain  "conjunctive -disjunctive"  and  "disjunctive -con¬ 
junctive"  generalizations  of  the  GLP  problem,  which  subsume  the  general 
mixed  integer  problem  in  the  same  way  that  the  GLP  problem  subsumes  the 
0-1  mixed  integer  problem.  (See  [11]. ) 

8.  Examples 

To  illustrate  the  ideas  of  the  foregoing  sections,  we  provide  the  follow¬ 
ing  geometric  and  numerical  examples: 

Consider  the  GLP  problem 

Minimize  1  xj  +  1  x2 
subject  to 


-1/2  x  !  - 

CM 

X 

£ 

-1 

5/2xj  + 

3x2 

£ 

23 

-5/2xj  + 

1x2 

£ 

1 

xl' 

x2 

2 

0 

and  (xj.Xg)  is  an  extreme  point  (i.  e. 

,  lies  on  a  0  dimensional  face)  of 

the  polytope  defined  by 

1  /  2  x  j 

-  1  x2 

£  1 

-2xj 

-  1  x2 

£  -2 

5/2  Xj 

-  1  *2 

£  9  . 
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Then 


P  =  {(Xj.Xg):  - 1  / 2 x j  -lx2  s  -1.  5/ 2xj  +  3x2  s  23,  -5/2xj  +  lx2  *  1. 
x,  iO,  x2  iO) 

and 

Q  =  l(xltx2):  l/2xj  -lx2  *  1.  -2xj  -lx2  s  -2,  5/2xrlx2  s  9}, 
and  the  tableau  representation  is: 

Maximize  xQ  =  0  +  l(-Xj)  +  l(-x2> 
subject  to 

Uj  =  1  +  1  /2( -x j >  -  l(-x2) 
u2  =  -2  -  2( -x  j )  -  1  ( — x 2 ) 

u3  =  9  +  5/2(-x1)  -  l(-x2) 
v j  =  0  -  1  (-x j)  +  0(-x2) 
v2  =  0  +  O(-Xj)  -  l(-x2) 
v 3  =  -1  -  l/2(-Xj)  -  Ii-X2) 

=23+  5/2(-xj)  +  3(-x2> 
v5  =  1  -  5/2 ( -Xj )  +  1  ( —  x 2 ) 


Table  1  illustrates  the  problem  in  the  detached  coefficient  form 
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Table  1 


The  geometry  of  this  problem  is  illustrated  in  Figure  1.  (From  this 
diagram  it  can  be  seen  that  the  GLP  problem  has  only  one  feasible  solution, 
namely,  the  point  at  the  intersection  of  the  hyperplanes  uj  =  0  and  u3  =  0.  ) 

The  inequalities  Uj  *  0,  i  =  1, 2,  3,  and  v}  i  0,  i  =  1,  2 _ ,5  define  the 

L.  P.  region.  The  inequalities  Vj  =  xj  i  0  and  v 2  =  x2  16  0  are  redundant  in 
this  example. 

As  shown  in  Table  2,  the  optimal  L.  P.  solution  occurs  at  the  intersection 
of  the  hyperplanes  u2  =  0  and  v3  =  0.  At  this  point  all  other  u.  and  v-  are 
positive  since  the  L.  P.  solution  does  not  lie  on  their  associated  hyperplanes. 
Thus  the  intersection  of  the  half  spaces  2  0  and  u3  a  0  contains  the  L.  P. 
solution  in  its  interior  and  serves  as  a  suitable  choice  for  R.  The  convexity  cut 
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is  thus  obtained  by  extending  the  edges  from  the  L.  P.  solution  until  they 
hit  the  first  hyperplane  Uj  =  0  for  i  =  1, 3  (i.  e.  ,  a  boundary  of  R).  As 
depic  ted  in  Figure  1,  edge  u2  =  0  may  be  extended  to  infinity  and  edge  v  =  0 

J 

may  be  extended  to  the  hyperplane  Uj  =  0.  The  cut  is  created  by  passing  a 
hyperplane  through  the  intersection  points.  Since  one  of  the  intersection 
points  is  along  the  displaced  ray  u2  -  0  at  infinity,  the  cut  involves  moving 
u2  =  0  parallel  to  itself  until  it  passes  through  the  point  of  intersection  of 
the  hyperplanes  v3  =  0  and  Uj  =  0.  This  is  labeled  Cut  One  in  Figure  1. 

The  algebraic  counterpart  of  extending  an  edge  until  it  intersects  R 
simply  amounts  to  increasing  the  value  of  a  current  nonbasic  variable  and 
determining  which  one  of  the  Uj  in  R  becomes  zero  first. 


Table  2 
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To  determine  the  cut,  we  identify  the  relevant  equations  for  defining  R 
from  Table  2  to  be: 

Uj  =  4/3  -  2/3u2  +5/3v3 
u3=  8  -  2u2  +  3v3. 

Holding  Vg  =  0  and  allowing  U2  to  vary  (i.e. ,  traveling  along  the  hyper¬ 
plane  v  =  0),  we  find  that 

Uj  =  0  iff  Ug  =  2 

Ug  =  0  iff  Ug  =  4  . 

Thus,  the  hyperplane  Uj  =  0  is  intersected  first  (as  may  be  seen  visually 
in  Figure  1).  Furthermore,  t*\  is  equal  to  2.  Similar  calculations  in¬ 
volving  v^  yield: 

Uj  =  0  if  Vg  =  -4/5 

u  =  0  if  v  =  -8/3  . 

3  3 

Since  all  of  the  values  for  vg  are  negative,  t*g  is  taken  to  be  +•  by  con¬ 
vention. 

The  convexity  cut  is  (l/t^lug  +  (l/t^lv,,  *  1.  Adding  a  slack  Vg  to 
transform  the  convexity  cut  into  an  equality,  we  obtain 

v6  =  -1  +  1/2u2  +  0v3  . 

(Notice  that  the  effect  of  the  cut  is  to  compel  Ug  to  be  greater  than  or  equal 
to  2.  This  likewise  corresponds  to  the  geometric  portrayal  in  Figure  1.  ) 
Upon  adjoining  the  convexity  cut  to  Table  2  and  iterating  to  the  new  L.  P. 
optimum,  Table  3  is  obtained. 
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Adjoining  this  cut  to  Table  3  (with  slack  v^)  and  finding  the  new 
optimal  L.  P.  solution  gives  Table  4  to  follow. 


-v?  -Uj 


xo 

-16/5 

6/5  2/5 

U1 

o 

0  -1 

u2 

4 

-2  0 

U3 

12/5 

8/5  -9/5 

V1 

14/5 

-4/5  2/5 

v2 

2/5 

-2/5  -4/5 

v3 

4/5 

-4/5  -3/5 

V4 

514/30 

61/30  7/5 

V5 

43/5 

-8/5  9/5 

v6 

1 

-1  0 

V7 

0 

-1  0 

Table  4 

The  solution  provided  by  this  table  improves  upon  the  previous  solu¬ 
tion  since  one  of  the  u^  is  now  nonbasic.  However,  still  another  Uj  must 
become  nonbasic  in  order  to  provide  a  feasible  solution  for  the  GLP  problem. 

Consequently  a  new  convexity  cut  is  calculated  relative  to  the  set 
R  =  {(xj.Xg):  u2  *  0,  u3  *0}.  (Note  that  this  R  is  coincidentally  the  same 
one  used  to  derive  Cut  Two.  If  ui  had  been  made  non-basic  by  replacing  the 
non-basic  variable  v^  in  Table  3,  Cut  Two  could  have  been  avoided. )  The 
convexity  cut  is  2/3vY+0u^il  (labeled  Cut  Three  in  Figure  1). 


Adding  this  convexity  cut  to  Table  4  and  finding  the  optimal  L.  P. 
solution  to  the  new  problem,  Table  5  is  obtained. 


Table  5 


The  L.  P.  solution  contained  in  Table  5  is  feasible  (and  optimal) 
for  the  GLP  problem  since  u3  can  obviously  be  made  non-basic.  Thus, 
the  GLP  problem  is  solved. 


FOOTNOTES 


The  name  "generalized  lattice  point  problem"  was  coined  for  this 
problem  by  William  M.  Raike. 

^Private  communications,  A.  Charnes,  Anthony  Fiacco,  Michael 
Kirby,  and  William  W.  Raike.  More  recently,  Kirby,  Love,  and  Swarup 
[Id]  have  proposed  solving  this  problem  by  procedures  ba.“ed  on  "extreme 
point  ranking"  and  "parallel  shifts  of  the  objective  hyperplane.  " 

^The  excellent  work  that  pertains  either  directly  or  indirectly  to 
the  convexity  cut  ideas  has  been  developed  by  Ragavachari,  M.  [14]  and 
Burdet  [5],  Recent  extensions  of  interest  are  also  to  be  found  in  [2,  3,4, 9, 

10,  13. 17]. 

^This  statement  is  slightly  more  general  than  the  original  statement 
of  Charnes,  which  requires  x  to  be  an  extreme  point  of  the  polytope 
Q'  =  {x:  D'x  =  d\  x  *  0).  It  is  interesting  to  note  that  the  attempt  to  cir¬ 
cumvent  the  non -negativity  restriction  on  x  in  the  definition  of  Q'  encounters 
some  difficulty.  In  particular,  the  standard  device  of  replacing  an  unre¬ 
stricted  variable  by  the  difference  of  two  non-negative  variables  fails  due 
to  the  introduction  of  extraneous  extreme  points.  For  example,  the  polytope 
(x:  xj  +  X2  =  1,  x2  +  X3  =  1,  x3  >  0)  has  one  extreme  point:  Xj  =  x3  =  0  and 
x2  =  1.  However,  the  corresponding  polytope  (y:  yj  -  y2  +  y3  -  y4  =  1. 

+  s  l-  y  *  °J*  where  Xj  *  yj  -  y2,  x2  *  y3  -  y4  and  x3  =  y5,  has 

two  extreme  points:  yj  =  y5  =  1,  y2  =  y3  *  y4  *  0  and  y3  =  Yi  =  ~ 

-  y^  =  0.  Only  the  second  of  these  corresponds  to  the  extreme  point  of  the 
original  polytope. 

5 

The  rules  for  column  tableau  pivoting  may  be  briefly  stated:  divide 
the  pivot  column  by  the  negative  of  the  pivot  element;  then  add  the  appropriate 
multiple  of  the  pivot  column  to  each  of  the  other  columns  so  that  the  resulting 
"updated"  pivot  row  will  have  0's  everywhere  except  in  the  pivot  column. 

As  observed  in  [8],  the  convexity  cut  lemma  is  also  valid  more 
generally  if  BQ  is  not  in  the  interior  of  R,  provided  there  is  a  deleted 
neighborhood  of  BQ  such  that  all  points  of  C  in  this  neighborhood  are  in  the 
interior  of  R. 

^This  case  cannot  arise  for  the  GLP  problem  when  R  =  Q  if  any 
components  of  u  are  nonbasic  (unless,  in  fact,  x  contains  only  1  component). 

®The  usual  statement  of  the  basis  exchange  theorem  is  (loosely) 
that,  given  any  pair  of  bases,  one  can  progress  from  one  to  the  other  through 
a  sequence  of  bases  in  which  any  selected  member  of  the  second  (not  pre¬ 
viously  selected)  replaces  some  member  of  the  first  (not  previously  replaced). 


An  easily  proved  consequence  of  this,  which  we  rely  on  here,  is  the  "reverse" 
theorem  that  states  (again  loosely)  one  can  remove  any  selected  member  of 
the  first  basis  (not  previously  selected)  and  find  a  member  of  the  second 
(not  previously  found)  to  replace  it. 

9This  connection  is  developed  by  Glover  in  (8). 

19This  assertion  follows  directly  from  considerations  introduced  in 
(9).  Note  that  this  relationship  to  earlier  cuts  circumvents  the  finiteness 
issue  for  the  present  cuts. 

l^The  fact  that  the  successive  convexity  cuts  are  all  parallel  in  this 
example  is,  of  course,  a  fortuitous  consequence  of  the  problem  structure 
and  is  not  to  be  expected  in  general. 
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